NONMONOTONE CONVERGENCE AND RELAXING FUNCTIONS
نویسندگان
چکیده
منابع مشابه
Nonmonotone Convergence and Relaxing Functions
In the minimization of real valued functions, Newton’s algorithm is often combined with a line search method. Grippo et al [SIAM J. Numer. Anal., Vol. 23, No. 4] first suggested a nonmonotone stepsize selection rule based on the maximum of a fixed set of previous function values. In this paper we introduce the notion of relaxing functions and suggest several other nonmonotone procedures using a...
متن کاملGlobal Convergence of a New Nonmonotone Algorithm
Abstract: In this study, we study the application of a kind of nonmonotone line search in BFGS algorithm for solving unconstrained optimization problems. This nonmonotone line search is belongs to Armijo-type line searches and when the step size is being computed at each iteration, the initial test step size can be adjusted according to the characteristics of objective functions. The global con...
متن کاملConvergence of MUSCL Relaxing Schemes
We consider the convergence and stability property of MUSCL relaxing schemes applied to conservation laws with stii source terms. The maximum principle for the numerical schemes will be established. It will be also shown that the MUSCL relaxing schemes are uniformly l 1-and T V-stable in the sense that they are bounded by a constant independent of the relaxation parameter , the Lipschitz consta...
متن کاملBackpropagation Convergence via Deterministic Nonmonotone Perturbed Minimization
The fundamental backpropagation (BP) algorithm for training artificial neural networks is cast as a deterministic nonmonotone perturbed gradient method. Under certain natural assumptions, such as the series of learning rates diverging while the series of their squares converging, it is established that every accumulation point of the online BP iterates is a stationary point of the BP error func...
متن کاملA Nonmonotone Filter SQP Method: Local Convergence and Numerical Results
The work by Gould, Loh, and Robinson [SIAM J. Optim., 24 (2014), pp. 175–209] established global convergence of a new filter line search method for finding local first-order solutions to nonlinear and nonconvex constrained optimization problems. A key contribution of that work was that the search direction was computed using the same procedure during every iteration from subproblems that were a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Pure and Apllied Mathematics
سال: 2013
ISSN: 1311-8080,1314-3395
DOI: 10.12732/ijpam.v83i2.13